The tasks and counterfactuals from the Mechanistic Interpretability Benchmark.

Mechanistic Interpretability Benchmark
university
AI & ML interests
Principled evaluation of mechanistic interpretability methods.
Recent Activity
Collections
1
models
3
datasets
7
mib-bench/ravel
Viewer
•
Updated
•
117k
•
60
mib-bench/arithmetic_subtraction
Viewer
•
Updated
•
20.9k
•
85
mib-bench/arithmetic_addition
Viewer
•
Updated
•
40.4k
•
94
mib-bench/ioi
Viewer
•
Updated
•
21k
•
329
mib-bench/arc_easy
Viewer
•
Updated
•
4.01k
•
26
mib-bench/arc_challenge
Viewer
•
Updated
•
2k
•
34
mib-bench/copycolors_mcqa
Viewer
•
Updated
•
1.89k
•
114